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Abstract 

A Boolean function on n variables is g-resilient if for any subset of at most q variables, the 
function is very likely to be determined by a uniformly random assignment to the remaining 
n — q variables; in other words, no coalition of at most q variables has significant influence on 
the function. Resilient functions have been extensively studied with a variety of applications in 
cryptography, distributed computing, and pseudorandomness. The best known resilient function 
on n variables due to Ajtai and Linial [AL93] has the property that only sets of size n(n/(log^ n)) 
can have influence bounded away from zero. However, the construction of Ajtai and Linial is 
by the probabilistic method and does not give an efficiently computable function. 

We construct an explicit monotone depth three almost-balanced Boolean function on n bits 
that is r2(n/(log^ n))-resilient matching the bounds of Ajtai and Linial. The best previous 
explicit constructions of Meka [Mek09] (which only gives a logarithmic depth function), and 
Chattopadhyay and Zuckerman [CZ15] were only (n^“^)-resihent for any constant 0 < /3 < 1. 
Our construction and analysis are motivated by (and simplifies parts of) the recent breakthrough 
of [CZ15] giving explicit two-sources extractors for polylogarithmic min-entropy; a key ingredient 
in their result was the construction of explicit constant-depth resilient functions. 

An important ingredient in our construction is a new randomness-optimal oblivious sampler 
that preserves moment generating functions of sums of variables and could be useful elsewhere. 

1 Introduction 

In this work we study resilient functions introduced by Ben-Or and Linial [BL85] in the context 
of collective-coin flipping. Consider the following game: There are n players who communicate 
by broadcast and want to agree on a random coin-toss. If all the players are honest, this is 
trivial: pick a player, have the player toss a coin and use the resulting value as the collective 
coin-toss. Now suppose that there are a few bad players who are computationally unbounded, 
can collude amongst themselves, and broadcast last in each round, i.e., they broadcast after 
observing the bits broadcast by the good players in each round. The problem of collective coin¬ 
flipping is to design protocols so that the bad players cannot bias the collective-coin too much. 
An important and well-studied case of protocols are one-round collective coin-flipping protocols. 
We will adopt the notation of boolean functions instead of protocols, as both are equivalent for 
a single round. 

Definition 1.1. For a Boolean function f : {O,!}” — {0,1}, and Q C [n], let Iqif) be the 
probability that f is not-determined by a uniformly random partial assignment to the bits not in 
Q. Let Ig{f) = minQc[n].|Q|<q^Q(/)- We say f is (g, (5)-resilient if Iqif) < 6. In addition, for 
0 < T < 1, we say f is r-strongly resilient if for all 1 < q < n, Iqif) < t ■ q. 

Intuitively, Iqif) quantifies the amount of influence any set of q variables can exert on the 
evaluation of the function /. If / is almost-balanced and Iqif) is small, say o(l), then evaluating 
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/ gives a one-round coin-flipping protocol that outputs a nearly unbiased bit even in the presence 
of up to q bad players. More information and discussion of other models can be found in the 
survey of Dodis [Dod06] . 

In their work introducing the problem, Ben-Or and Linial constructed an explicit balanced^ 
(l/n“)-strongly resilient function for a = log 3 2. Subsequently, the seminal work of Kahn, 
Kalai, and Linial [KKL88] showed that for any balanced function /, Iq{f) = 1 — o(l) for 
q = uj(n/ \ogn). Following this, Ajtai and Linial [AL93] showed the existence of a balanced 
function that is r-strongly resilient for r = 0(log^ njn)', this in particular implies the existence 
of a (f2(n/log^ n), 1/3) resilient function. However, the construction in Ajtai and Linial is 
probabilistic and does not lead to an efficiently computable resilient function—it only gives a 
non-uniform polynomial-size circuit for computing such a resilient function. We construct an 
efficiently computable function matching the existential result of Ajtai and Linial: 

Theorem 1.2 (Main). For some universal constants Ci,C 2 > 1 the following holds. There exists 
an efficiently computable function f : {0,1}" —^ {0,1} such thafi 

• f is almost-balanced: Pra:e„{o,i}" [/(s^) = 1] = l/2± 1/10. 

• f is {ciifog^ n)/n)-strongly resilient. 

• f has a uniform depth 3 monotone circuit of size at most . 

The best previously known explicit resilient functions as above could only tolerate roughly 
at most q <C bad players for all constants 0 < /3 < 1: [Mek09] gave such a function of 
logarithmic-depth while the recent breakthrough of [CZ15] gave such a function of depth 4. 

The existential guarantee of [AL93] is slightly stronger than the above; they show the exis¬ 
tence of a balanced constant-depth function with similar resilience; however, their function is 
not monotone^. Our construction essentially matches theirs while being efficiently computable. 
We can have the bias of the function be 1/2 ± o(l) at the expense of reducing the resilience; see 
Corollary 7.4 for one such trade-off. 

1.1 Two-source extractors 

The present work builds on a recent breakthrough of Chattopadhyay and Zuckerman [CZ15] 
who gave an explicit two-source extractor for poly-logarithmic min-entropy sources—resolving 
a longstanding problem in pseudorandomness. One of the main building blocks of their work is 
an efficiently computable resilient function with a stronger guarantee described below. We no¬ 
ticeably simplify the construction and analysis of [CZ15] and obtain better quantitative bounds. 
We explain these next starting with the definitions of extractors. 

For a random variable A, the min-entropy of X is defined by 

H^{X)= min (log 2 (l/Pr[A = a:])). 

x^bupport{X) 

A two-source extractor is a function that takes two high min-entropy sources and outputs a 
nearly uniform random bit: 

Definition 1.3. A function Ext : {0,1}" x {0,1}" —>■ {0,1} is a {n,k) two-source extractor 
with error e if for any two independent X, Y with iJoo(A), iloo(K) > k, Ext{X, Y) is e-close to 
a uniformly random bit. If Ext(X,Y) has full support for all such sources X,Y, then we say 
Ext is a two-source disperser. 

^We say / : {0,1}" —>■ {0,1} is balanced if Pra;g„{o,i}" lf{x) = 1] = 1/2. 

^Henceforth, for a multi-set S, x S denotes a uniformly random element of S. 

^While it is possible to make their construction monotone, this blows up the depth. 
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Extractors have many applications across several areas including cryptography, error-correcting 
codes, randomness amplification; we refer the reader to the history of the problem in [CZ15] 

(the references are too many). By the probabilistic method, there exist two-source extractors 
with error for all k > 21ogn (even outputting n{k) bits; as in [CZ15] we only focus on 

extracting one bit in this work). Constructing such functions explicitly, as is required in most 
applications, is much harder and has been studied extensively. 

Until very recently, the best explicit two-source extractor due to Bourgain [Bou05] required 
min-entropy at least k > cn for some constant c = 0.49... < 0.5; the best explicit two-source 
disperser due to [BRSW12] required min-entropy at least exp(poly(loglogn)). Chattopadhyay 
and Zuckerman broke the barrier for two-source extractors and gave an explicit construction 
for min-entropies at least C'(logn)’^"‘; independently, Cohen [Cohl5] gave an explicit two-source 
disperser for min-entropy log*^ n for some (unspecified) constant C. We show the following: 

Theorem 1.4. For a sufficiently big constant C, there exists an explicit (n, k) two-source ex¬ 
tractor D : {0,1}" X {0,1}" {0,1} with constant-error for k > Clog^® n. In particular, we 

get an explicit {n,k) two-source disperser for k > Clog^^n. 

Theorem 1.5. For any constant c > 1, there exists a constant C such that there exists an 
explicit {n,k) two-source extractor Ext : {0,1}” x {0,1}” —> {0,1} with error \/n^ for k > 
Clog^^n. 

Two-source extractors and resilient fnnctions Along with the above quantitative 
improvements, our construction and analysis simplify [CZ15]: 

• [CZ15] uses several known extractors in their construction of n^“^-resilient functions for 
all constant 0 < /3 < 1; we present a simpler construction based on Reed-Solomon codes. 

• More importantly, the analysis of [CZ15] uses Braverman’s celebrated result— [BralO] — 
that polylog-wise independence fools constant-depth circuits. We present a direct and 
self-contained analysis without recourse to Braverman’s result that in turn uses several 
non-trivial tools from the study of constant-depth circuits, e.g., [Raz87], [Smo87], [LMN93]. 

Chattopadhyay and Zuckerman reduce the problem of computing two-source extractors to 
that of constructing an explicit n^“'^-resilient function for some constant J > 0 with the following 
stronger property; this reduction was also implicit in [Lil5]. A distribution V on {0,1}” is t-wise 
independent if for X V, and all I C [n] with |/| < t, the projection of X onto the coordinates 
in /, Xj, is uniformly distributed over {0,1}^. 

Definition 1.6. For a Boolean function f : {0,1}” —>■ {0,1}, Q C [n], and a distribution D on 
{ 0 , 1 }[” 1 \Q, let Iq, vif) be the probability that f is not-determined by setting the bits not in Q 
according to V. Let Iquif) = ■ Q ^ IQI ^ <L V is t-wise independent}. We 

say f is t-wise ( 9 , e)-resilient if Iq,tif) < £■ addition, for 0 < t < 1, we say f is t-wise 
T-strongly resilient if for all 1 < q < n, Iq^tif) ^ t ■ q. 

The core of [CZ15] is the construction of a poly(log n)-wise {n^~^, l/n*^d))_j-esilient function 
for all /3 > 0. They achieve this as follows: a) Construct an explicit constant-depth mono¬ 
tone (n^“^, l/n^^^^)-resilient function, b) Apply Braverman’s result to conclude that for all 
g, e > 0 , a constant-depth monotone (< 7 , e)-resilient function is also t-wise (g, 2 e)-resilient for 
t = poly(log(n/e)). In contrast, our analysis of resilience is robust enough to imply resilience 
even under limited independence with little extra work. As a corollary, we get the following: 

Theorem 1.7. For some universal constant c > 1 the following holds. There exists an efficiently 
computable function f : { 0 , 1 }” —>■ { 0 , 1 } such that, 

• f is almost-balanced: For any (clog^ n)-wise independent distribution D on {0,1}", Pr^,..., v[fix) 
1] = 1/2 ± 1/9. 
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• f is {c\og^ n)-wise [c{\o^ n)/n)-strongly resilient. 

• / has a uniform depth 3 monotone circuit of size at most . 

As in the case of Theorem 1.2, we can have the bias of the function be 1/2 ± o(l) at the 
expense of reducing the resilience. 


1.2 Oblivious samplers preserving moment generating functions 

A critical ingredient in our proof of Theorem 1.2 is an explicit oblivious sampler with optimal— 
up to constant factors—seed-length that approximates moment generating functions (MGF). 
We state this result next which may be of independent interest. 

Theorem 1.8. For all 0 < p, < 1, 1 < v,w, there exists an explicit generator G : {0,1}’’ [u]*" 

such that for all functions fi, ■ ■ ■, fw ■ [v] ^ [ 0 , 1 ] with [/*(^)] = 


E 


2Er=i/i(G(y).) 


1 -I- 0(/i). 


The seed-length of the generator is r = 0(w -\- (logu) -I- r(;((loglogu) -I- log(l//i))/(logu>)). 

We state a more precise version which works for estimating E [exp {9 ■ /*( ))] for 9 > 0, 

i.e., the MGF, in Section 6 ; here we focus on the above for simplicity and as it captures the 
main ideas. 

Let us first compare the above with known randomness efficient samplers such as those of 
[Zuc97, Gil98, Kah97]. For concreteness, let us consider the special case when v = and 

p = these are the parameters we face in our application. The seed-length of Theorem 1.8 in 
this case is 0{w). On the other hand, the samplers of [Zuc97, Gil98, Kah97] when instantiated 
to obtain a guarantee as above require a seed-length of log w). The improvement from 
(^(rclogw) to 0{w) is critical in our application; as we enumerate our all possible seeds even¬ 
tually, the improvement from 0{w log w) to 0{w) in seed-length translates to an improvement 
from super-polynomial running-time to polynomial running-time of the resilient 

function. 

To illustrate the gap further, with the above parameters, let Xi = fi{xi) for an independent 
uniformly random Xi Gu [r'] and let 1/ = fi{G{y)i), where G is as in the theorem. In this case, 
standard Ghernoff bounds imply that for a sufficiently big constant G, 


Pr[A'i -I - \- Xui > Gw/(log w)] < exp{-w). (1.1) 

Our argument in Section 6 shows that our generator satisfies the same property: Pr[Yi -|- 
• • • + Fm > Gw/(logr(;)] < exp(—w). Note that the seed-length used by our generator for this 
setting is 0{w) which is optimal^. 

In contrast, if one uses the expander sampler as in [Gil98, Kah97, Hea08] on an expander 
graph with degree D the best one could get using the current analyses is (cf. Corollary 23 of 
[Hea08]), 

Pr[Yi -I- • • • -I- Tu, > Gw;/(logr(;)] < exp(— re • (1 — /D'^))). 

In other words, to get an exp(—w) bound on the tail-bound, one needs the degree D of the 
expander to be as the number of random bits needed by such a generator is (log?;) -I- 

■u;(logZl), the total seed-length will be 0{wlogw). Similarly, applying the analysis of expander 
Ghernoff bounds from [Gil98, Kah97, Hea08] to get a bound on the MGF as in the theorem 
requires the degree of the expander to be at least This in turn requires the total seed- 

length to be r2(r(; logw). 

^To get a tail bound of exp(—u;), the sample space has to have exp(u;) points. 
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Another potential approach for constructing samplers as in theorem is to apply the pseu¬ 
dorandom generators (PRGs) for small-space machines of Nisan or Impagliazzo, Nisan, and 
Wigderson [Nis92, INW94]. However, to obtain a guarantee on the MGF as in the theorem 
or to satisfy Equation 1.1 in the special-case above, we need to instantiate the generators with 
error <C exp(—w). This in turn forces the seed-length of the generators to be ft{wlogw). 

2 Overview of construction 

We next give a high level overview of our main construction and analysis. First, some notations: 

• Throughout, by a partition P of [n] we mean a division of [n] into lu-sized blocks Pi,..., P^,, 
where v = njw (we assume w divides n). 

• Let Vp denote the product distribution on {0,1}" where each bit is p-biased. 

As in [AL93] and [GZ15] our construction will be an AND of several Tribe functions: 

Definition 2.1. For a partition P = {Pi,...,Pi,} of [n] into w-sized blocks, the associated 
Tribes function is the DNF defined by Tp = Vj^i [Ag^p^Xi). A collection of partitions V = 
{P^,..., P“} defines a function f = fp : {0,1}" —>■ {0,1} as follows: 


fp{x) := /y Y /y = /\ Tpi(x). 

j=i \kep: J i=i 

The final function satisfying Theorem 1.2 will be fp for a suitably chosen set of partitions. 
To analyze such functions, we first state two abstract properties that allow us to analyze the 
bias as well as influences of such functions; we then design partitions that satisfy the properties. 
The properties we define are motivated by [GZ15] and abstracting them in this way allows us to 
give a modular analysis of the construction. The partitions themselves will be designed using 
the sampler we construct in Theorem 1.8 which forms the core of our analysis and construction. 
The analysis of resilience under limited independence follows a similar approach in addition to 
some careful, but elementary, calculations involving elementary symmetric polynomials. 


Analyzing bias The first condition allows us to approximate the bias of functions of the 
form fp. 


Definition 2.2. Let V = {P^,... ,P“} be a collection of partitions of [n] into w-sized blocks. 
For d < w, we say V is a d-design if no two blocks across any of the partitions overlap in more 
than w — d elements: formally, for all a ^ (3 G [u\, and i,j € [u], |P“(*) G P^{j)\ < w — d. In 
addition, for d < k < w and 6 G (0,1), we say V is a {d, k, 5)-design if it is a d-design and for 
all a G [u], and i,j G [u], 


Pr 

/SSuM 


|P“nPf| <w-k 


> 1 


-(5. 


We should think of fc d. Intuitively, the first condition says that any two blocks arising 
in our partitions differ in at least d elements (i.e., do not overlap completely); in contrast, the 
second condition says that with probability 1 — d, two random blocks differ in at least k elements 
(i.e, have very little overlap ii k d). 

When a collection of partitions V = {P^,..., P“} satisfies the above condition, the following 
claim gives a formula for the bias of fp. To parse the formula, even if clearly false, suppose that 
the tribes involved in fp were on disjoint sets of variables. Then, we would have 




Pr 

ufO.l}' 


[Tp4x) = 1] 


(1 — (1 — 2 ™)^)“ := bias(M,u,u;). 
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The next claim shows that when V forms a (d, k, (5)-design, the different tribes behave as if they 
are on disjoint sets of variables and the above formula for the bias is approximately correct. As 
is sufficient in our applications, we specialize to the case where bias(u,?;,w) is close to 1/2; this 
corresponds to choosing® v = 0(l)u>2“' and u such that 1/3 < bias(u,r!,r(;) < 2/3. 

Theorem 2.3. Let V = {P^,...,P“} he a collection of partitions of [n] into w-sized blocks 
that is a {d,k, 5)-design. Let u,v,w be such that v = 0(l)rc2“' and 1/3 < bias(M,n,ty) = 
(1 - (1 - 2"“)^)“ < 2/3. Then, 


Pr [f'p{x) = 1] — b\as{u,v,w) 

a:6„{0,l}" 


0 (l)rt;exp(—n(d)) 

0 (1) • {w exp(—r2(fc)) + exp(—f2(d)) + 2“d) 


The proof of Theorem 2.3 is similar to the arguments in [CZ15] and relies on Janson’s 
inequality. However, our argument is more subtle as we need to handle (d, k, d)-designs and not 
just d-designs as is done there. In particular the theorem implies that when P is a d-design with 
d ^ logw, the error is at most exp(—H(d)). On the other hand, when d ^ logic we can use 
the second formula if fc ^ logic. We need the more refined statement above where only most 
blocks are far from each other as this is what our construction achieves. 


Analyzing influences We next specify a sufficient condition on a collection of partitions 
V = {P^,, P“} to guarantee that small coalitions have small influence on f-p. 

Definition 2.4. Let V = {P ^,... ,P“} be a collection of partitions of [n] into w-sized blocks. 
We say V is {q,T)-load balancing if for all Q C [n] with \Q\ < q, and j G [c], 


E 

ot€u[u] ■ 


i(gnP“ ^0)21*3^^ 




< T • {q/v). 


To gain some intuition for the definition and the use of the name load balancing we first 
view partitions as hash functions. A partition P = {Pi,... ,Py} can be seen as a hash function 
hp : [n] [c]: hp{i) = j if i G Pj. We can then also view a collection of partitions V as defining 

a family of hash functions TL = {{p : V G V}. The definition above then says that a random 
hash function from the family TL is load-balancing in a certain concrete way. In particular, for 
any subset Q C [n], and any particular bin j G [n] , the number of items hashed into bin j satisfy 
the following inequality: 


E 




< T 


m/v). 


Indeed, standard Chernoff bounds imply that the above property is clearly satisfied by truly 
random hash functions. Thus, the partitions we construct can be seen as imitating this property 
of truly random hash functions but with a much smaller size family. 

We show that load-balancing partitions give us fine control on the influences: 

Theorem 2.5. Let V = {P ^,..., P“} he a collection of partitions of [n] into w-sized blocks that 
is {q,T)-load balancing. Then, 


Wv) < {u{l - 2-)’'-^) . (r2-) . q. 

A similar claim is used in the analysis of [AL93, CZ15]. However, [CZ15] work with the 
stronger condition that for any Q C [n] with \Q\ <C q, |gnP“| <C w for most a (as opposed to just 
having a bound on the expectation of I). The above generalization, while straightforward, 

is important as one cannot hope to satisfy their stronger requirement for Q very large 
as needed for the proof of Theorem 1.2. 

®Our arguments also give analogous, albeit more cumbersome, bounds for all u, v, w and even other product 
distributions. 
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2.1 Constructing nice partitions 

We next outline how to construct a collection of partitions which is a good design as well as 
sufficiently load-balancing. Fix v^w. For a string a G [v]'^ , define an associated partition of 
[n] = [fw] into w-sized blocks as follows: 

• Write {1, .. .vw} from left to right in w blocks of length v each. Now, permute the fc’th 
block by shifting the integers in that block by adding ak modulo v. 

• The Fth part now comprises of the elements in the i’th position in each of the w blocks. 

Formally, for i G [u] = {{k — l)u -I- ((i — at) mod v) : k G [w]}. As in [CZ15], our final 

function will he f-p ioj: V := Vu = {P°‘ : a G U} for a, suitably chosen set of strings U C [u]“; 
in their work, U is chosen by using known seeded extractors. 

For intuition, fix a constant 0 < /3 < 1 and first consider the case where U is the set of 
Reed-Solomon codewords corresponding to degree £ > 1//3 polynomials over [u] Then, a 
simple calculation shows that Vu is a (w — ^)-design; that is, no two blocks in the partitions 
of V overlap in more than £ positions. Further, note that a random element of U is £-wise 
independent; combining this with standard Chernoff-type bounds for Awise independent hash 
functions implies that V is (g, 0/3(l))-load balancing for q <C Setting the parameters 

appropriately and applying Theorems 2.3 and 2.5 shows that fp is almost-balanced and 
resilient—giving a simpler construction matching [CZ15]. 

For the main theorem. Theorem 1.2, we follow the same outline as above using Theorem 1.8 
to get a suitable set of partitions. Indeed, a look at the definition of load-balancing suggests 
that Theorem 1.8 should be relevant as it also involves a similar expression. Concretely, as a 
first attempt, we take U to be the range of the generator from Theorem 1.8 and study the bias 
and influence of / = fp^. Theorem 1.8 immediately implies that Vk is (fl(n/logn), 0(l))-load 
balancing. This combined with Theorem 2.5 implies that / is 0((log^ n)/n)-strongly resilient. 

To complete the proof, we need to show that / is almost-balanced. Unfortunately, Vu need 
not be a good-enough design to apply Theorem 2.3 directly. We get around this at a high-level 
by encoding parts of the output of the oblivious sampler in Theorem 1.8 using a Reed-Solomon 
code; doing so, we get Vu to be a (C, t(;/2, 2“‘"’")-design for any large constant C. We then 
apply Theorem 2.3 to show that / is almost-balanced. We leave the details of the encoding to 
the actual proof. 

2.2 Construction of the oblivious sampler 

The generator is obtained by instantiating the Nisan-Zuckerman [NZ96] PRG for small-space ma¬ 
chines with k-wise independent seeds being fed into the extractor rather than truly independent 
ones. Concretely, let E : [u'^] x [D] —)■ [u] be a (c(logz;)/2, e)-extractor (see Section 3 for formal 
definitions) with error e « 1/w. For £ = 0(w/(logw)), let Gt : [D]^ [D]^ generate a £-wise 

independent distribution. Then, our generator satisfying Theorem 1.8, G : [u'^] x [DY —t [u]“ is 
defined as follows: 


G{x, y) = {E{x, Ge{y)i),E{x, Ge{y) 2 ), ■■■ , E{x, Gi{y)^)). (2.1) 

While the above construction serves as the base, in our proof of Theorem 1.2 we need a 
generator that satisfies certain additional constraints: output strings on different seeds should 
be far from each other. We satisfy these constraints by careful modifications of the above 
construction. 

^Assuming for simplicity that a is a prime. 
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2.3 Analyzing bias and resilience under limited independence 


The extension to obtain resilient functions under limited independence, as in Theorem 1.7, 
follows from our analysis of Theorem 2.3 along with the following claim. The core of the proof 
of Theorem 2.3 involves calculating the biases of disjunctions of a small number of Tribes, i.e., 
functions of the form h = VaeiTpc, where are partitions of [n] and |/| is not too large. We 
directly show that such functions are fooled to within error e by 0{\I\^w^ + |/|w log(l/e))-wise 
independence; that is, for any 0(|Jpw^ + |/|wlog(l/e))-wise independent distribution V on 

{o,ir. 


Pr 

.{ 0 . 1 } 


[VaeiTp<^{x) = 1] - Pr [VaeiTp^{x) = 1] 


< e. 


The proof of the above claim involves standard approximations based on the inclusion-exclusion 
principle and some inequalities involving elementary symmetric polynomials. 


3 Preliminaries 


3.1 Pseudorandomness 


We first recall some standard notions from pseudorandomness. 


Definition 3.1. A collection of random variables {Xi,...,Xm} is k-independent if for any 
I Q [™]) |1| ^ k, the random variables {Xi : i G 1} are independent of each other. 

Definition 3.2. For a distribution X, Hao{X) = minj-gg^ppo^^qx) log(l/Pr[J'f = x]). 

Definition 3.3 ([NZ96]). A function E : [A^] x [D\ [M] is a Ik, e)-strong extractor if for every 

distribution X over [TV] with Hoo{X) > k, and Y Gu [D], {Y, E{X,Y)) is e-close in statistical 
distance to the uniform distribution over [D\ x [M\. 

We need the following sampling properties of strong extractors, c.f., [Zuc97]. 


Lemma 3.4. Let E : [A'^] x [D] -G [M] be a {k,e)-strong extractor. Then, for all functions 
gi,...,gp) : [M] {0,1}, with p, = {^/D)J2i^xeulM][9i{x)]j there are at most 2^ elements 

X G [A^] such that 


^ XI 9z{E{x,z)) - p 

ze[D] 


> e. 


We also need the following explicit extractor construction due to Zuckerman [Zuc97]: 

Theorem 3.5. There exists a constant C > 1 such that for all e > 0, and 1 < M < there 

is an explicit {{log N)/2,e) -strong extractor E : [TV] x [D\ —>• [M\ with D = {{log N) / e)^ . We 
also assume without loss of generality that E{X,Y) is uniformly random over [M] when X,Y 
are uniformly random over [TV] and [D] respectively. 


Finally, we also need the following explicit generator of £-wise independent distributions 
which follows for instance from the Reed-Solomon code. 


Definition 3.6 (Shift-Hamming distance). For two sequences x,x' over an alphabet let 

dH{x,x') = minQg[B] \{i G [d] : Xi — x{ ^ a mod B}\. 

Lemma 3.7. For all prime v and 1 < I < m < v, there exists an explicit function Gi : [vY 
[u]™ such that 

• For any y ^ y' G [vY, dH{y, y') > m - £. 

• For y Gu [vY, Gi{y) is l-wise independent. 






Proof. Follows by using the Reed-Solomon code over [u] of degree £ and length m. □ 

We need the following theorem of [DETTIO] on fooling read-once Conjunctive Normal For¬ 
mulas (CNFs) using limited independence. A CNF / : {0,1}” ^ {0,1} is said to be a readonce 
formula if each variable appears in at most one clause. The width of a CNF is the maximum 
length of any clause in the CNF. 

Theorem 3.8. There exists a constant C such that the following holds for all 0 < e < 1 and 
t > Cw\og{l/e): For any width w read-once CNF f : {0,1}" {0)1} o,nd t-wise independent 

distribution V on {0,1}", 




< S. 


3.2 Probability 

We next review some results from probability theory. 

We need Janson’s inequality from probability theory, c.f., [ASll] that allows us to bound 
the bias of monotone Disjunctive Normal Formulas (DNFs). 

Theorem 3.9. Let Si ,..., Sm C [n] he a collection of sets and define fi : {0,1}" ^ {0,1} by 
fi{x) = Aj^SiXj. Let X Gu {0,1}". Then, 


= 1] < Pr 

2=1 


/\hfiix)) = 1 

j=i 


< exp 


1-7 


J|Pr h/i(a:) = 1] , 


where 7 = max™ Pr[/i(a;) = 1] and 


A = Pr[/z(a;) A ffix) = 1]. 


The following immediate corollary is more convenient for us. 

Theorem 3.10. Let Si,..., Sm C [n] be a collection of sets and define fi : {0, 1}" — >• {0, 1} by 
fi{x) = Aj^SiXj. Let X Gu {0,1}", and Zi = ffix) for i G [m]. Then, 

m m 

nE[(i-^.)]<E 11(1-^*) 

2 = 1 U^l 

where 7 = max^^ ^[^i] 

A= ^ E[Z,Zfi. 

i^j'.SinSj^0 

We need the following instantiation of Holder’s inequality. 

Fact 3.11. Let Yi, ... ,Yr be real-valued random variables. Then, 

r 

E[|YiY 2 ---Y,|] < 

2=1 


/ A \ 

<exp(-—) -J^EKl-Z,)], 

^ ' i=l 


Definition 3.12. For any collection of variables xi,..., Xm and 1 < a < rn, Sa{xi,..., Xm) = 
S/C[m],|/|=a riie/ Xi denotes the a ’th symmetric polynomial. 

We will use the following bound on moments of symmetric polynomials of independent 
Bernoulli random variables; see the appendix for proof. 
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Lemma 3.13. Let 0 < p < 1/2 and Xi,..., Xy be independent indicator random variables with 
Pr[Xi = 1\ = p. Then, for k > 2e^vp, and all r > 1, 

E[Sk{Xi,...,Xyy] < (l/2)^ 

We will use the following standard fact about symmetric polynomials. 

Fact 3.14. For all 1 < a < m and 0 < qi, ■ ■ ■ ,qm with qi < p, Sa{qi, ■ • ■, Qm) < (™) 

We need the following elementary approximations; see the appendix for proofs. 

Fact 3.15. For all x >2, e“^(l — 1/a;) < (1 — 1/xY < e~^. 

Fact 3.16. Let \ <w<v<u, B>1 with 0 < v — 2’"(ln(u/ln2)) < B, and 9 = (1 — 2 “’")’'. 
Then, (l + 6 »)“ = 0(1) and (1 - 6 »)“ = 1/2 ± 0(B lnM)2-“'. 


4 Analyzing bias 

Here we prove Theorem 2.3. Let V = {P^, ■ ■ ■, H“}, f-p, be as in the theorem statement. Let 
X Gu {0,1}" and for a G [ m ] let Za = Tpc(x). Then, 

fp(x) = n = n 


The theorem essentially states that ]E[nQ, ^a] ~ prove this by showing 

that Za’s satisfy a weak notion of limited independence. Roughly speaking, we will show that 
for I C [u], |/| < d, 


E 


.a^I 


nE[(i-z„)]. 

a^I 


(4.1) 


The proof of Equation 4.1 uses Janson’s inequality and the design properties of V. The theorem 
then follows by writing 


Y[Zc,= J|(l - (1 - Zo,)) = Y, 5a({l - : a G [u]}) 

OL ol a—1 

and applying Bonferroni inequalities to truncate the latter expansion to the first d terms; the 
error from the truncation is bounded by applying Equation 4.1. We next gives a concrete form 
of Equation 4.1. 

Lemma 4.1. Let V be as in Theorem 2.3 and {Zq,} ’s be as defined above. Then, for all a < d, 
. (1 _ 2 -)-“ < E [Sail - Zi, 1 - Z 2 ,..., 1 - Z„)] < 7 • • (1 - 2 -“')"“, 

where 7 = exp (^0{l)wd2~^^'^'>^ + 2^^"^^. 

Note that E[Za] = (1 — 2““’)" for all a G [m]. Therefore, if the Z^s were actually independent 
of each other, then E [5'a(l — ^ 1 ,1 — ^ 2 , • ■ •, 1 — Zy)] = (“) (1 — 2 ““)"“. Thus, the lemma says 
that for a design, the expectation of the symmetric polynomial is close to what it would be if 
{Zq,}’s were independent of each other. 

Before proving the lemma, we first show it implies Theorem 2.3. 
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Proof of Theorem 2.3. Let 2'a’s be as above; for brevity, let Ya = 1 — Za and 9 = {1 — 2 
Note that 


Pt[Mx) = 1] = E 


n z. 


E[Z„] = (1 - 6 »)" = bias(M, V, w). (4.2) 

Q:G[u] 


Now, by Bonferroni inequalities, we have 

d-l 

]qz„ = 1[{1 - y„) = ± Sd{Y„..., r„). 


a =0 


Thus, 


E 




d-l 


-J2{-^YnSaiYu...,Yu)] 


a—0 


<E[5d(yi,...,r„)]. 


Further, by Lemma 4.1, for all 1 < a < d, 


r<E[,Sa(ri,...,r„)] <7 (^)r. 


Let Yl,... ,Yf be independent random variables with Yf having the same marginal as 1^. 
Clearly, E[5'Q(y'/,... ,Yf)] = Therefore, for any a < d, 


|E[5,(yi,..., T„)] - E[5,(y/,..., K)]| < (7 - 1) Q 9Y 


Combining the above inequalities, we get 

d-l 


E 


nz. 




a =0 


d—1 / \ 

<E[5d(yi,...,r„)] + (7-i)^ r b' 

a=l 


<7(q0" + (7-i)(i+0)"- 


Note that the above arguments also apply to the case when Zfs were truly independent of each 
other with 7 = 1 . Therefore, 


E [Zi • • • ZJ - ]q E[Z,] 
ie[«] 



6»‘^ + 2(7- l)(l + 0)“. 


We next simplify the error bound by plugging in the values of 7 and 0 . Recall that 
bias(M,'c, w) = (1 — d)" G [1/3,2/3] so that (1 +0)" = 0(1) and 9 = 0{l/u). Therefore, 


ni[ z^] - n iE[z„] 

Oi^U OiGu 


exp(-n(d)) + 0(7 - 1 ). 


(4.3) 


Note that 1 is a trivial upper bound on the left-hand side; further, a simple calculation shows 
that 


min(l, 7 — 1) = min ^1, exp (o(wd)2-^('=)) -b - 1) 

< min ^1, exp (o(wd)2-^('=)) - 1) + 2^^^^6 
= 0(u;d)2-^('=) -b 20('")d = 0(w)2-^('=) -b 2°(“)d, 
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where we used the fact that for all A > 0 min(l,e'’' — 1) = 0{\) and d2 < k2 = 

Combining the above with Equation 4.2 and Equation 4.3 we get 

\Pr[f'p{x) = 1] — bias(it, t!, w)| < exp(—f2(d)) + 0{w) exp(—r2(fc)) + 

This proves the second bound of the theorem. The first bound is a special case as any 
(d, fc, (5)-design is also a (d, d, 0)-design by definition. □ 

Proof of Lemma 4-.1. We first further break up each Za according to the blocks of the partition 
P“; for each i G [u], let Zai = Aj^p<^Xj (recall x G„ {0,1}"). Then, Z^ = yi^\v\2ai so that 
\-Za = Therefore, for any / C [m], 

OL^l OL^l iGv 


Note that we can apply Theorem 3.10 to the latter product. Fix a set / C [u]. Define {a,i) ^ 
{/3,j) to be adjacent, {a,i) ^ i/3,j), if P“ n 0. Let, 


A/ = ^ 'E[Zai-Zpj]. 

{a,i)r^{P,j)^Ix[v\ 


We next bound A/. Let dj = w — max{|P“ ^ Pj\ '■ a ^ j3 € I j & [v]} quantify the 
maximum overlap among any two blocks of the partitions P°‘^a G I. Then, as 7^ is a d-design, 
di > d for all /. Fix a yf: ,5 G / and an in index i G [■(;], and let ji,... ,jb G [f] be the indices 
such that (a, i) ~ {13, j), and let wi = |P“ fl |. Then, 1 < wi,... ,Wb <w — di. Now, 

b b b 


E 


ElZaiZpj] = = Y = 2-2’" . Y 2“'L 




e=i 


e=i 


e=i 


As Wi € [w — d/], and J2i f^e above expression is maximized by setting as many of the 

WiS to w — di as possible. Thus, 


b 

^ 2 ’"^ < \w/{w-di)']2^-‘‘^ =2^\w/{w -di)]2-^^ < 
e=i 


Therefore, 

^ E[Z^apj] = 

Summing over all indices {a,i), we get 


Ai < {vd) ■ 2 i -’"-'^’'/2 = 0 {wd 2 -^A 2 y 


Finally, observe that maxajE[Zai] = 2 ’" < 1/2. Thus, by Theorem 3.10, 


n E[(l - ^c)] < E l[{l-Zo,) 

ol£I .Cn^l 


< exp(2A/) • l[E[{l-Z^)]. 

a&I 


(4.4) 
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Note that E[(l — Za)] = (1 — 2 Therefore, summing over all sets I C [u], |/| = a gives 
us the lower bound of the claim. For the upper bound, we have 

E[5„(l-Zi,...,l-Zj] < (1-2—r • ^ exp(2A,) 

<(1-2-’")™- ^ eMOiwd2-^^/^))) 

= (1 - 2 -™)™ • 

We next bound the last expectation. From the design properties of V and a union bound applied 
to all possible pairs (a,*), {13, j) £ I x [u], it follows that for I (^a^)) 

Pr[d/ < /c] = Pr ^ /3 € I, i,j£ [u] |P“ fl | > w — k 

- H Prf3a^/3e/ \P°‘n Pj‘\ > w - k 

i,je[v] 


(“) • E 

exp(0(wd2-‘'"/2))) 

va/ /£.(':') 



Hence, 


E 


exp (o(l)wd2-‘^^/2) = Pr[d/ <k]-E exp (^0{l)wd2-‘‘^\di <k 


This proves the lemma. 


Pr[d/ > fc] • E 


exp I 


< 


(o(l)u;d 2 -'^’/ 2 ) \di>k 
exp (o(l)r(;d 2 -'=/ 2 ) + (v'^d'^S) ■ exp (o{l)wd2-^/^^ 
exp (o(l)wd 2 -'=/ 2 ) +2^<^'"'>S. 


□ 


4.1 Analyzing bias nnder limited independence 

We next a state a version of Theorem 2.3 for distributions with limited independence. 

Corollary 4.2. Let V = {P^,...,P“} be a collection of partitions of [n] into w-sized blocks 
that is a {d,k, 8)-design and e € (0,1). Let u,v,w be such that v = 0(l)w2™ and 1/3 < 
bias(M,u, ic) = (1 — (1 — 2 -™)")“ < 2/3. LetV be a {C{w‘^d'^ wdlog{l/e)))-wise independent 
distribution for C a sufficiently large constant. Then, 


Xr-^D 


1 ] 


bias(u, V, w) 


0{l)w exp{—Q{d,)) 

0(1) • {w exp(—H(fc)) + exp(—H(d)) + 2'^S) 


We prove the corollary by repeating the proof of Theorem 2.3 while using an analogue of 
Lemma 4.1 for x ^ P. To do so, we will use the following claim saying that limited independence 
is sufficient to fool disjunctions of a few Tribes. 

Claim 4.3. The following holds for some constant C > 1. Let {P^,..., P"} be a collection of 
partitions of [n] into v blocks of length w each with v = 0(l)w2“. Then, for any Cwr{w + 
r log(l/e) + r‘^)-wise independent distribution P over { 0 , 1 }", 


Pr 


['^ae[r]Tp°‘{x) = o] 


Pr [v„gp]Tp<»(a:) = O] 


< e. 
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Proof. The lemma follows from some careful approximations of elementary symmetric polyno¬ 
mials. We first setup some notation. Let k > max(2r, 2e^r'2““') be an even integer to be chosen 
later and let a: ^ 2? where is a t-wise independent distribution for t > kwr. For a G [r], 
let = (Xf,...,X“) where Xf = Note that Tpc.(x) = We will use 

inclusion-exclusion to approximate each Tpo(x). Let pk, ek '■ {0,1}’' —>■ {0,1} be defined by 

k — 1 n 

Pk{Zl, ...,Zy)= ^(-l)^S'f(Zl, . . . , Zy), ek{Zl, ...,Zy)= ^ ( - 1 ) ^ 5^ (Zl , . . . , Zy). 
i=0 i=k 

By the inclusion-exclusion formula, for all z G {0,1}’', -^OR{z) = Pk{z) -I- efc(z). Further, by 
Bonferroni inequalities, for all z G {0,1}'“, 

0 < efe(z) < S'fc(z). (4.5) 


Now, 


1 - y<.e[r]Tp^{x) = n ^OR{X^) = n (Pfe(^“) + efe(X“)) (4.6) 

= \[pk{X'^)+ Y. \{pk{X<^)\[ek{X<^) ■ 

ae[r] /^ 0 C[r]a^/ aC/ 

'-V-" '■-V-' 

■. = Pk{x) :=Ek(x) 

We view Pk as a low-degree polynomial approximation for the left-hand-side and Ek as the 
error term. Indeed, Pk is of degree at most kwr in x as each pk{X°‘) is of degree at msot 
k in {Xf ,..., X“}’s which in-turn are of degree at most w in x. Therefore, for t > kwr, 
E[Pfc(a:)] is the same under all t-wise independent distributions. We next bound the expectation 
of Ek under t-wise independent distributions. By Equation 4.5, 0 < efe(z) < S'fc(z); further, 
\pk{z) \ = |-'Oi?(z) - efc(z)| < 1 -I- efe(z) < 1 -|- S'fe(z). Thus, for any fixed 0 / C [r]. 


E 


l[ek{X‘^)l[pk{X<^) 

a£l a^I 


< E 


n 5 fe(x“)n(i+^fc(^“)) 

-OiGl Oi^I 


< n [Skix^yf^'' • n [(1+5fe(x“))n'/" 

Oi^I Ol^I 


(by Fact 3.11) 

<Y[e[S kixyY" - 11(1 + ®^ [Skix^Y]^/^) 

ct£l ot^I 

(by Minkowski’s inequality). 


Note that S'fe(X“)’’ is of degree at most kwr as a polynomial in x. Therefore, E[5'fe(X“)’’] is the 
same under all t-wise independent distributions and in particular the same as for x Gu {0,1}”. 
However, in this case {Xf,... ,X“) are independent indicator random variables with E[X“] = 
2“’". Therefore, a.s k > 2e^v2~'", by Lemma 3.13, 

E[5fe(X“)n < (1/2)'= < 1. 

Combining the above estimates we get that for all / 0 C [r], 


E 


nefc(x“)npfc(^“) 

Ot^l Oi^I 


< (l/2)(l^l)('=/’' ■ 2’'-l^l < 2’’ • (1/2)'=/’’. 
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Plugging the above into equation Equation 4.6 we get E[|Efc(a;)|] < 2^’’(l/2)^/’’. Finally, as the 
above estimates hold under any t-wise independent distribution and Pk is of degree at most 
kwr, we get that 


Pr [\/ae[r]Tpo^{x) = O] - Pr [v„6[r]Ip“(a;) = O] 

L L J J L L J J 


< E [\Ej,{x)\]^ E [\Ef,{x)\]<2 

XGu Xr^T> 


2r+l 


( 1 / 2 ) 


k/r 


Plugging in fc = max(3r(r + log(l/£)), 2ev2 we get the above error to be at most e. It follows 
that it suffices for t = kwr to be C(wr(r^ +r log(l/£) + w)) for a sufficiently big constant C. □ 

Proof of Corollary 4.2. The proof of the corollary is similar to that of Lemma 4.1 and Theo¬ 
rem 2.3 with one change. Using the notation from the above proof, for any I C [u], the event 
nc<e/(l — Za) corresponds to the unsatisfiability of VaeiTpo>. By using the above theorem, we 
get an analogue of Equation 4.4 for the present case as well: for any / C [u] with |/| < d, 


n E[(l -Z^)]-e<E 


ael 


11(1-^“) 


.aGl 


< exp(2A/) ■ 


(4.7) 


aei 


The corollary now follows by using the above inequality in place of Equation 4.4 in the rest 
of the proof of Theorem 2.3. □ 


5 Analyzing influence 

Proof of Theorem 2.5. Let Q C [n] with \Q\ = q. Note that for every a € [u], a partial 
assignment x to the variables not in Q leaves Tpa undetermined if and only if 

1. For every part P“ that does not intersect Q, = 0 for some i € P“. 

2. For some j G [u] with Pff C\Q ^ Xi = \ for every i G (P“ \ Q). 

The above two events are independent of each other. The probability of (1) is at most (1 — 
2-'^Y~q as there are at least v — q parts of P“ that do not intersect Q. The probability of (2) 
is at most 


E 


2-{w-\pfnQ\) ^ 


iGH:P“nQ/0 


Therefore, for a Gu [u]. 


Igifr) < X! ^q(^P“) ^ ® , [^q(^P“)] 

Q;G[nJ 


< M • E 


(1 _ 2 -™)’'-? 


ueH:P?nQ/0 


< m(i - 2-’")’'-«2-'" • y E l(P“ngy^0)2l^/^<5l 

\ L 

VgH 

< m(1 - 2-’")’'-« • 2-'" • rg. 


□ 


We next a state a version of Theorem 2.5 for distributions with limited independence. 
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Corollary 5.1. Let V = {P^,...,P“} be a collection of partitions of [n] into w-sized blocks 
that is {q,T)-load balancing. Then, for all t > Cw\og{l/e) for some sufficiently big constant C, 

hAfv) < («(1 - . (r2-’")g + [uv)e. 

Proof. The argument is similar to that of Corollary 4.2. Let P be a t-wise independent distri¬ 
bution on {0,1}”. As in the above proof, observe that Q leaves Tpa undetermined if and only 
if 

1. For every part P“ that does not intersect Q, Xi = 0 for some i € P“. 

2. For some j G [u] with P“ C Q 7 ^ 0, cci = 1 for every i G (P“ \ Q). 

However, the above two events are no longer independent. For a fixed a, let J C [ri] be all parts 
P^ that do not intersect Q. Then, the first condition above is equivalent to 


hix) ■■= /\ 

jeJ 



Similarly, the second condition is equivalent to 


f2{x) := y 



We are interested in 

Pr [/i(x) A hfx) = 1] = Pr [/i(a;) = 1] - Pr [/i(a;) A hf 2 {x)) = 1]. 

x^T> x<—T) x-f^—T) 

Now, observe that 


faix) ■■= fi{x) A {^f 2 {x)) = /\ 


V A 


V 



jeJ VePf / j^J \i€Pf\Q ) 

Now, /i ,/3 are both read-once CNFs, that is CNF formulas where each variable appears at 
most once. Therefore, by Theorem 3.8, for t ^ rclog(l/e). 


Pr [/i(a^) = 1] - ^ = 1] 


< e, 


Pr [/3(x) = 1] - ^ 
c-<—X> xe, 


Pj„.[/3(») = 1 ] 


< £. 


Therefore, 


Pr [/i(a;) A / 2 (x) = 1] < Pr [/i(x) A / 2 (x) = 1] -b 2£ < 

x-(-T> a:eu{0,l}" 


(1 _ 2-“)’'-'? . I I -b 2£, 

UGH:P“nQ/0 


where the last inequality follows from the arguments of Theorem 2.5. The main statement now 
follows by repeating the calculations of Theorem 2.5 with the above equation leading to an 
additional error of 2{uv)e. □ 
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6 Oblivious sampler preserving the moment generating 
function 


Here we prove Theorem 1.8; it will be the main building block in our final construction of 
resilient functions. With a view towards future use, we modify the construction presented in 
the introduction (Equation 2.1) even if the simpler construction described there suffices for 
Theorem 1.8. 

Let e = fi/w, and c a sufficiently big constant to be chosen later. Let E : [u'^] x [D] —>• [v/D] 
be a ((clogu)/2, e)-strong extractor as in Theorem 3.5 with D = ((logu)/e)‘^ for some universal 
constant C. Without loss of generality, suppose that D is prime. For a parameter .£ > 1 to be 
chosen later, let Gi : [DY —>■ generate a £-wise independent distribution as in Lemma 3.7. 

Define G : [u'^] x [DY —>■ [u]™ as follows: 

G{x, y)^ = G^{y)^ o E{x, Gi{y)i), (6.1) 

where we associate [D] x [v/D] with [u] in a straightforward manner. 

To analyze the generator we shall use the following lemma about random variables with 
limited independence. A similar statement appears in [GKM15]; however, our setting is consid¬ 
erably simpler and we give a direct proof in the appendix. 

Lemma 6.1. Let Yi,... be l-wise independent random variables supported on [0,1]. Then, 
for all 9 > 0, 

E [exp(6>(Fi H-h Fu,))] < PjE[exp(0yi)] -I- exp(26»w) , 

Towards proving Theorem 1.8, we first prove a lemma with some precise but cumbersome 
bounds on the moment generating function. 

Lemma 6.2. Let G : [u'^] x [DY [u]“' he as in Equation 6.1 and let /i,..., /„, : [u] —>■ [0,1] he 
functions with = T- ct = G{x,y) for {x,y) Gu x [DY■ Then, for all 9 >0, 

< exp(e^we) ■ exp(e^y,) + exp(29w) ws) ^ + exp(9w) ■ 

Proof. Let Yi = fi{ai). Note that for any fixed x, the random variables Fi,..., Fy, are Awise in¬ 
dependent with respect to the randomness of y. We bound the expectation of exp {9 J^i fY^i)) = 
exp {9Y^^Yi) as follows: 

• Using sampling properties of extractors. Lemma 3.4, w show that with probability at least 

1 - over x G„ [u°], E^ [F^] < ^ -I- we. 

• We then apply the previous lemma to the F^’s conditioned on x satisfying the above event. 
For i G [w], call x G i-bad if 


E 


exp 




|E[Fi|x] - y,i 


E 

ze^lD] 


[fi{z o E{x, z))] - yi 


> e. 


Call X € [v^] bad if it is j-bad for some j G [x^] and good otherwise. Fix j G [x/;]. For z G [D], 
define : [v/D] -G [0,1] by g^x') = fj{zox'). Then, Y.ze[D\'^x'&„,[v/D][9z{x')\ = DEj]/,-] = 
DpLj] thus, X is j-bad if and only if 


( 1 /^) YI 9z{E{x,z)) - yj 
ze[D] 


> e. 
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Therefore, by Lemma 3.4, for every j € [w], there are at most bad strings. Thus, 
Pra;G„[«c] [a; is j-bad] < Then, by a union bound, Pr 2 ,g^[„c][x is bad] < Finally, 

conditioned on x being good, 

= 12 ° < 12(f^^ + ^) = ( 6 - 2 ) 

j j ^ j 

Now, conditioned on x, the random variables Fi,..., Tuj are £-wise independent by the defi¬ 
nition of G{x,y). Therefore, by Lemma 6.1, for good x, 


exp 


oY.h{c 


= E 
y 


exp Yi 

- i^Yi)] + exp(26'w) + 

< n (l + («“)E[K|) +exp(2«„.) 

< exp((e*')y]]E[r,]) +exp(2^w) + 

i ^ 

< exp((e®)(^ -I- we)) + exp(20w) 

Finally, as exp(0^ ■/^(ai)) < exp(0u>) always, we get that 

e{ijL + we) 


E 

x,y 


exp 


/»(«») 


< exp((e“)(/r -|- we)) + exp{26w) 


+ Pr[x is bad] exp(0u>) 


< exp(e®u'£) ■ exp(e®/r) -|- exp(20r(;) _|_ exp{6w) ■ {wv 


□ 


Proof of Theorem 1.8. The theorem follows by applying the above lemma with e = y/w, 6 = 
ln2, i = 12w/(logw). Note that for this setting, there exist extractors as in Equation 6.1 with 
D = ((logx)/e)'PP^ so that 


logZl = 0(loglogx -I- logw -I- log(l/^)). 
With this setup, as /i < 1, we get 


E 

zeu{o,iT 


exp ( 6 iE/*(G'W*) 


< exp(2u'e) ■ exp(2^) -I- exp(2r(;) 
<1-1- 0{fi) + exp(w) • wv~‘^^'^, 


2eyL 

~T 


exp(?w) 


,-=/2 


as £ < y/w. We now set c = C'max(l, {w + log(l//r))/(logx)) for a sufficiently large constant 
C so that the last term is also 0(/r). 

The seed-length of the generator is 


r = clogx -I- ^(logll) = 0(logx -I- w -I- ?x((loglogx) -I- (log(l/^)))/(log w)). 


The theorem now follows. 


□ 
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7 Explicit resilient functions 

Here we present our main construction proving Theorem 1.2. Fix v,w. For a string a G [r']™, 
define an associated partition P“ of [n] = [uw] into u>-sized blocks as follows: 

• Write {1,.. .vw} from left to right in w blocks of length v each. Now, permute the fc’th 
block by shifting the integers in that block by adding ak modulo v. 

• The Fth part now comprises of the elements in the i’th position in each of the w blocks. 

Formally, for i G [w] = {{k — l)u + ((i — at) mod v) : k G [w]}. As in [CZ15], our final 

function will be f-p for V = {P“ : a C for a suitably chosen set of strings U C [«]“'. 


7.1 Polynomially resilient functions from Reed-Solomon code 

For intuition, we first use our arguments to present a simpler variant of the construction of 
[CZ15] (e.g., the function below is depth 3 as opposed to the depth 4 construction of [CZ15]) to 
get a (n^“'^)-resilient function from Reed-Solomon codes as alluded to in the introduction. 

Let 1 < w < ?;, where v is prime. For some parameter f > 1 to be chosen later, let Ge : [vY ^ 
be an Awise independent generator as in Lemma 3.7 and let TZS = {G'^(x) : x G [u]^}. Let 
/ = f-ps = fv, where V = : a G TZS}. We show that for any constant 0 < /3 < 1, and 

i > 1/2/3, fps is r2(n^“^)-resilient and has bias 1/2 ± 

Lemma 7.1. For 1 < £ < w, fps as defined above is a (w — £)-design. 

Proof. First note that for any a,/3 G [x]’" and i,j G [u],, = \{k G [u>] : fik — ctk = {j — i) 

mod u}| < w — dnipi^fi). From the properties of TZS as in Lemma 3.7, for a yf ,5 G TZS., 
dH{a.,j3) > w — £. Therefore, for a /3 G TZS, |P“ ^ -P/l S: w — dH{a,l3) < £. The claim now 
follows from the definition of design. □ 

Lemma 7.2. For 1 < £ < wj^, TZS is {q,T)-load balancing for t = 2^ + 2“(g/u)^“^. 

Proof. The argument here is similar to the proofs of Chernoff bounds for random variables with 
limited independence (especially those typically used in analyzing limited independence hash 
functions). 

Let Q C [n] with \Q\ = q <v and fix an index j G [u]. Let a G„ TZS and let X = \Q (1 P“|; 
note that E[Ar] = q/v. We are interested in estimating E[l(Ar > 0)2''^]. We do so by first proving 
a tail bound on X. To this end, for 1 < i < w, let 




if j - a* G Q n {{i - l)u -I- 1, (i - l)u -I- 2,..., (i?;)} 
otherwise 


Then, from the definition of the parition P°‘, X = Xi + X 2 -f ■ • ■ -f Further, as each Xi 
only depends on ai, Xi ,..., are £-wise independent. Therefore, by a standard calculation, 


Pr[X>^] <E[^,(Xi,...,X^)] = ^ E 


Hv 

. 1^1 






w 


where the last inequality follows from Fact 3.14. Now, as E[Ar] 
simplifies to 


(a)' 


q/v, the above expression 
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Thus, for £ > 3, 


E 


l(QnP“ 7 ^ 


E [l(X > 0)2^] 


= Pt[X < ^]E [l(X > 0)2'^|X < i] +Pr[X > ^]E [1(X > 0)2'^|X > £] 
< 2^ Pr[X > 0] + 2“ Pr[X > i] 

<2\q/v) + 2'^{q/vY. 


The claim now follows from the definition of load balancing. □ 

We next use the above claims along with Theorems 2.3 and 2.5 for a suitable setting of 
parameters. 

Lemma 7.3. For all 0 < 6 < 1, there exists a constant > 1 and a suitable choice of 
V = 05 ( 2 ™i(;) such that the following holds. For £ > 1/5, the function f-jis as defined above is 
cs2~'^-strongly resilient and Pra;g„{o,i}"[/ tcs(;c) = 1] = 1/2 ±2“^^'^^. 

Proof. Let £ = max(3, [1/(5]). For v to be chosen in a little bit, let u = and / = fns- We 
would like our choice of v to minimize \v — 2'^ ln((ln 2 )/ri^)| so that we can get an almost-balanced 
function using Fact 3.16. To this end, let (f : K_|_ —>■ R be defined by 

(j){x) = X — 2^ ln((ln 2)x^) 

and let a;* > 1 be such that (f>{x*) = 0. There exists such an x* by the continuity of </>. It is also 
easy to check that for w sufficiently large, 4>'{y) > 0 for all y > x*. We set v to be the smallest 
prime larger than x*."^ Note that v < x* + B where B = 2“”^“ for some universal constant ci < 1 
(see [Wik] for instance), so that 0 = (/{x*) < (j){v) < (/{x*) + B. Let 9 = {1 — 2““')’'. Then, by 
Fact 3.16, (1 -b ey = 0(1) and 

bias(it, V, w) = (1 - 6 »)“ = 1/2 ± 0(l)2-^(’"). 


Now, by Lemma 7.1 and Theorem 2.3, 

Pr [fns{x) = 1 ] = bias(M, v, w) ± exp(—ll(r(; — £)) = bias(w, v, w) ± exp(—ll(r(;)). 

rc-<-r>i/2 


Next, by Lemma 7.2 and Theorem 2.5, for any q < 2™P as £ > [1/(5], 

Wns) < u{l - 2—)"-« . (2-“g) ■ (2^ + 2-(g/u)'-i) 

< 0(1) • i2-^q) ■ (2^-b 2“2-^^“) 

= 0 ^( 2 -“g). 

Therefore, fns is 05 ( 2 “’")-strongly resilient. □ 

Corollary 7.4. For all 0 < 5 < 1, there exists a constant cs > 1 such that the following 
holds. There exists an explicit depth-three monotone function f : {0,1}" —> {0,1} which can be 
computed in time such that for t > csflognY 

• f is almost balanced: for any t-wise independent distribution T) on { 0 , 1 }", Pr^, = 

1] = l/2±n-^(P. 

• f is t-wise -strongly resilient. 

^We can find such a prime in time 2'^*-’"! which is fine for us. 
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Proof. We instantiate the previous lemma to get / = fns for S' = S/2. Then, n = 0(2“' 
so that To analyze the bias under <-wise independent distributions, we 

apply Corollary 4.2 with d = w/2, e = 1/n instead of Theorem 2.3 in the above argument. 
Similarly, to analyze the influence under t-wise independent distributions we use Corollary 5.1 
with e' = 1/(n^) instead of Theorem 2.5. Then, the amount of independence needed is 0{w^d^ + 
rycilog(l/e)) = 0 (log"^ n). □ 

7.2 Proof of Theorem 1.2 

We now prove Theorem 1.2. The approach is similar to the above with one crucial difference: 
we use the output of the generator from Theorem 1.8 instead of the Reed-Solomon code. We 
ensure the requisite design properties to apply Theorem 2.3, at a high-level, by padding the 
output of the generator with a Reed-Solomon code. 

Let c be a sufficiently big constant to be chosen later and suppose that v,D are prime 
numbers below. Let E : [u“] x [D] —>■ \v/D] be a strong extractor with error e = poly(l/w) and 
D = poly(r(;) to be chosen later. Let i = 0(ui/(logui)) be a parameter to be chosen later. Let 
Gc : b]'^ —t Gi : [DY generate a c-wise independent distribution over [u] and a 

Gwise independent distribution over [D] respectively as guaranteed by Lemma 3.7. 

Now, define U : b“] x [dY —[u]’" as follows: 


G{x,y)i 


Gc{x)i if 1 < z < 2c 

Ge{y)i-2c o E{x, Ge{y)i_2c) if 2c < z < w 


(7.1) 


(Here, we associate an element of [D] x [v/D] with an element of v in a straightforward bijective 
manner.) 

Abusing notation, we let Id = {U{x, y) : x £ b°], z/ G [DY} Q [u]*" as well. Our final function 
will be / = /p for V = {P°‘ : a £ U}. The following claims help us apply Theorem 2.3 and 
Theorem 2.5 to analyze f-p. 

Lemma 7.5. For all c < {w — £)/3, V is a {c,w — 2c — 1/D^)-design. 

Proof. Note that for any a, /3 G [u]’", and any z, j G [u], |P“ = |{fc G [w] : Pk—ak = {j — i) 

mod z;}| < w — dnia, p). 

Let a = G{x,y) p P = G{x',y') £ U. We consider two cases depending on whether 
y p y'. Hyp y', then dH{a,P) > dH{Gpy),Ge{y')) > w - 2c- p similarly, ii x p x', then 
dzz(a,/3) > dniGcix), Gc{x')) > c. Therefore, dH{a,P) > min(c,'u; — 2c — (.) = c. Hence, P is a 
c-design. 

Now, consider any fixed a = G{x,y) £ U, i,j £ [u], and P = G{x',y') £u U. Then, by the 
above argument, ii y p y', dH{a, P) > w — 2c — t so that |P“ C Pj^ | < 2c -I- £. On the other hand, 
Pr[z/' py]>l- 1/DP Thus, 

Pr [|P“ n Pf I > w — (w — 2c — £)] < Pr[z/' = y] < l/D^. 

/3£uW ■' 


Therefore, P is a (c, zc — 2c — £, l/P>^)-design as needed. □ 

We next use Lemma 6.2 to analyze the load-balancing properties of P. 

Lemma 7.6. Let U be as in Equation 7.1 for E being a {{clogv)/2, s)-extractor for e < 1/w 
and I > 6zc/(logzc). Then, P = {P“ : a £ U} is {q,T)-load balancing for q < v and t = 
0(22“-p(z;zc2“')z;-“/2). 
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Proof. Let Q C [n] with \Q\ = q <v and fix an index j £ [?;]. Let a W and let X = |(5nP“|; 
note that E[X] = q/v. For 1 < z < w, let 




it j - ai £ Q n {{i - I)?; + 1, (z - l)z; + 2,..., (zz;)} 
otherwise 


Then, from the definition of the parition X = Xi + X2 + • • • + X^^. 

For brevity, let E[X] = fi = q/v < 1, Y = ^ = J27=2c+i^i- Note that 

X = Y + Z . We are interested in estimating E[1(X > 0)2^]. We do so mainly by applying 
Lemma 6.2 to the random variable Z combined with the trivial observation that Y is at most 
2 c: 


E 


l(QnPfc“ ^ 


= E [1{X > 0)2^] = E [ 2 ^] - Pr[X = 0] 

= E [2^^] - 1 + Pr[X > 1] 

< E [ 2 ^] - 1 + E[X] 

= E[2^ - 1] + E[2^(2^ - 1)] + M 

< E[2^ - 1] + 2^= • E[2^ - 1] + M 

< Ep^^y] + 2^^ • E[2^ -l]+p 


By Lemma 6.2 applied to Z with 0 = ln2, £ = 12zc/(logzc), and e < l/2zi;, we get that 


E[ 2 ^] = 0 (l)exp( 0 (^)) + 2 ' 

< 1 + 0{^l) + 2-“' + 0(zi;2“)z;-^/2 

Further, E[F] < E[X] = /r. Therefore, as /i > 1/v, 


0{w2'^)v 


-c/2 


E 


1(Q n Pf‘ + 0)2l«^^^“ll < 0{2^^)fi + C)(l)zi;2“n-=/2 < 0(1) • fi ■ (2^^= + zi;2“z;-'=/^+^). 


□ 


Proof of Theorem 1.2. The theorem follows essentially by combining the above two lemmas and 
Theorem 2.3, Theorem 2.5. We first set up some parameters. Let c > 2 be a sufficiently large 
constant to be chosen later. Let zc > 1 be arbitrary and e = 1/zc^. Let D = ((clogz;)zc)‘" 
for some universal constant C so that there exists an explicit (c(log z;)/2, e)-strong extractor 
E : [z;'^] X [D\ -£ [v/D\ for all c > O as in Theorem 3.5. Set v = 0(2’"zc) to be chosen 
precisely in a little bit. For this setting of v, let U C [z;]’" be as defined in Equation 7.1 with 
£ = \2w/{\ogw) and E as the extractor. Let V = Vu- Then, \U\ := zz = z;" x . We will show 
that f = f-p satisfies the conditions of Theorem 1.2 for c sufficiently large. 

As in the proof of Lemma 7.3, we would like v to be as close as possible to 2’" ln((ln 2)zz). 
To this end, let (f) : 1R+ —>■ M be defined by 

4>{x) = X — 2'^ {chrx + C £ ln(log x) + C£ ln(czz;) + In In 2) 

and let a:* > 1 be such that (j){x*) = 0. There exists such an x* by the continuity of (f. Let 
V be the smallest prime larger than x*. Note that v < x* + B where B = 2"’’" for some 
universal constant ci < 1 (see [Wik] for instance), so that 0 = (/{x*) < 4>{v) < (/{x*) + B. Let 
0 = (1 - 2-’")". Then, by Fact 3.16, (1 + 6 ')“ = 0(1) and 

bias(zz,z;,zc) = (1 - 0)’’ = 1/2 ± 0(l)2-^(’"). (7.2) 
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Analyzing bias: By Lemma 7.5, 7^ is a (c, w — 2c — l/Z?^)-deisgn. Therefore, by Theo¬ 
rem 2.3, 


Pr [fv{x) = 1] = bias(M, v, w) + wexp(—f2(ic)) + exp(—r2(c)) + 2“'/£)^ 

= bias(M, V, w) + exp(—r2(c)), 
as 2*“ for C a sufficiently large constant. 

Analyzing influence: We claim that fv has small influence for coalitions of size o(2“). 
Let 1 < <7 < u so that q/v < 1. Then, by Lemma 7.6, V is (( 7 ,T)-load balancing for 

T = 0 ( 22^)(1 + = 0 ( 22 =). 

Therefore, by Theorem 2.5, for all g < u, 

hifv) < U{1 - ■ 22=(2-™9) = 0(22=)2—g = 0 ( 22 =) . ^ 

Here, the last inequality follows as 2“’ = 0(n/(log2n)). 

The theorem now follows by choosing c to be a sufficiently large constant. □ 

We next prove Theorem 1.7. 

Proof of Theorem 1.7. The proof is exactly the same as the above argument for Theorem 1.2 
but instead of using Theorem 2.3 we use Corollary 4.2 with d = c, e = 1/u and instead of 
Theorem 2.5 we use Corollary 5.1 with e = l/{uv^). The amount of independence we need is 
t 0{w'^d'^ +wd\og{l/e)) = 0{log^ n) as required for the theorem. Note that the error 1/9 
can be made to be an arbitrary small constant. □ 

8 Better two-source extractors 

Our improved quantitative bounds for two-source extractors follow immediately by using our 
resilient functions. Theorem 1.7 and Corollary 7.4 in the reduction of [CZ15]. Concretely, [CZ15] 
show the following for some universal constants 0 < c < 1 and (7,(7' > 1. Suppose for some 
functions £ : Z+ ^ [0,1], and t : Z+ —?> Z_|_, the following holds: for all to > 1, there exists 
an explicit t(TO)-wise (to^“=, e)-resilient function / : {0,1}"* —{0)1} with Pr^-g^jopim [/(x) = 
1] = 1/2 ± e(rn). Then, there exists an explicit {n,k) two-source extractor with error at most 
£{vP) and k > C ■ (t(n‘^))'^ log^ n. Instantiating this reduction with the resilient function from 
Theorem 1.7 (with 1/9 replaced with a sufficiently small constant) gives Theorem 1.4; similarly, 
using Corollary 7.4 gives Theorem 1.5. 


References 

[AL93] Miklos Ajtai and Nathan Linial. The influence of large coalitions. Combinatorica, 
13(2):129-145, 1993. 

[ASll] N. Alon and J.H. Spencer. The Probabilistic Method. Wiley Series in Discrete 
Mathematics and Optimization. John Wiley & Sons, 2011. 

[BL85] Michael Ben-Or and Nathan Linial. Collective coin flipping, robust voting schemes 
and minima of banzhaf values. In 26th Annual Symposium on Foundations of Com¬ 
puter Science, Portland, Oregon, USA, 21-23 October 1985, pages 408-416, 1985. 


23 


[Bou05] 


[Bra 10] 
[BRSW12] 

[Cohl5] 

[CZ15] 

[DETTIO] 

[Dod06] 

[Gil98] 

[GKM15] 

[Hea08] 

[INW94] 

[Kah97] 

[KKL88] 

[Lil5] 

[LMN93] 

[Mek09] 

[Nis92] 

[NZ96] 

[Raz87] 


J. Bourgain. More on the sum-product phenomenon in prime fields and its applica¬ 
tions. International Journal of Number Theory, 01(01):l-32, 2005. 

Mark Braverman. Polylogarithmic independence fools AC^ circnits. J. ACM, 57(5), 
2010 . 

Boaz Barak, Anup Rao, Ronen Shaltiel, and Avi Wigderson. 2-source dispersers 
for entropy, and Ramsey graphs beating the Frankl-Wilson construction. Ann. 
Math. (2), 176(3):1483-1544, 2012. 

Gil Cohen. Two-source dispersers for polylogarithmic entropy and improved ramsey 
graphs. CoRR, abs/1506.04428, 2015. To appear in STOC 2015. 

Eshan Chattopadhyay and David Zuckerman. Explicit two-source extractors and 
resilient functions. Electronic Colloquium on Computational Complexity (ECCC), 
22:119, 2015. To appear in STOC 2015. 

Anindya De, Omid Etesami, Luca Trevisan, and Madhur Tulsiani. Improved pseu¬ 
dorandom generators for depth 2 circuits. In APPROX-RANDOM, pages 504-517, 
2010 . 

Yevgeniy Dodis. Eault-tolerant leader election and collective coin-flipping in the full 
information model, 2006. 

David Gillman. A chernoff bound for random walks on expander graphs. SIAM J. 
Comput., 27(4):1203-1220, 1998. 

Parikshit Gopalan, Daniek Kane, and Raghu Meka. Pseudorandomness via the 
discrete fourier transform. In IEEE 56th Annual Symposium on Foundations of 
Computer Science, FOCS 2015, Berkeley, CA, USA, 17-20 October, 2015, pages 
903-922, 2015. 

Alexander Healy. Randomness-efficient sampling within nc^. Computational Com¬ 
plexity, 17(l):3-37, 2008. 

Russell Impagliazzo, Noam Nisan, and Avi Wigderson. Pseudorandomness for net¬ 
work algorithms. In Proceedings of the Twenty-Sixth Annual ACM Symposium on 
Theory of Computing, 23-25 May 1994, Montreal, Quebec, Canada, pages 356-364, 
1994. 

Nabil Kahale. Large deviation bounds for markov chains. Combinatorics, Probability 
& Computing, 6(4):465-474, 1997. 

Jeff Kahn, Gil Kalai, and Nathan Linial. The influence of variables on boolean func¬ 
tions (extended abstract). In 29th Annual Symposium on Foundations of Computer 
Science, White Plains, New York, USA, 24-26 October 1988, pages 68-80, 1988. 

Xin Li. Three-source extractors for polylogarithmic min-entropy. In IEEE 56th 
Annual Symposium on Foundations of Computer Science, FOCS 2015, Berkeley, 
CA, USA, 17-20 October, 2015, 2015. 

Nathan Linial, Yishay Mansour, and Noam Nisan. Constant depth circuits, fourier 
transform, and learnability. J. ACM, 40(3):607-620, 1993. 

Raghu Meka. Explicit coin flipping protocols, 2009. Unpublished manuscript. 

Noam Nisan. Pseudorandom generators for space-bounded computation. Combina- 
torica, 12(4):449-461, 1992. 

Noam Nisan and David Zuckerman. Randomness is linear in space. J. Comput. 
Syst. Sci., 52(l):43-52, 1996. 

A. A. Razborov. Lower bounds on the size of bounded depth circuits over a complete 
basis with logical addition, 1987. 


24 



[Smo87] Roman Smolensky. Algebraic methods in the theory of lower bounds for boolean 
circuit complexity. In Proceedings of the 19th Annual ACM Symposium on Theory 
of Computing, 1987, New York, New York, USA, pages 77-82, 1987. 

[Wik] Wikipedia. Prime gap — Wikipedia, the free encyclopedia. 

[Zuc97] David Zuckerman. Randomness-optimal oblivious sampling. Random Struct. Algo¬ 
rithms, ll(4):345-367, 1997. 


A Missing proofs 

Proof of Lemma 3.13. For a set T C [ti], let n(T) = |{(/i,...,A) : \Ij\ = k,\/j € [r] and 
=T}\. Then, 

5fe(Ai,...,A,r = ^ n 


Thus, 

E[Sk{X„...,X^Y]= n(T)Y^\. 

rcH 

Finally, observe that for any T with |r| = t, n{T) < Q)'' < {et/ky. Thus, 


E[5fe(Ai,...,X„n 




< ( 1 / 2 )", 


as evp/t < 1/4, and e^vp/k < 1/2. □ 

Proof of Fact 3.16. Note that under the assumptions we must have v = Lt{2'^w). Then, by Fact 
3.15, 

(1 _ 2-«')S-H2“ln(V(ln2)) < 0 < (1 _ 2-“')2“'InWO" 2)) < {\^2)/u. 

Therefore, (1 + 0)“ = 0(1) and 


(1 - ey > (1 - (In2)/M)“ > 1/2(1 - (In 2 )/M )'''2 > - 0{l)/u). 


Further, 


Thus, 


d> ((ln2 )/u)-(l-2 -“)^+'"«'"")“) > ((In2 )/M)-(1-0(5 +Inw)2-“). 
(1 - 6>)" < exp(-n6») < (l/ 2 )(^-°(^< 1/2 ± 0(51nu)2-“'. 


□ 


Proof of Lemma 6.1. The proof relies on the following elementary inequality about symmetric 
polynomials: for all 0 < ai,..., a^, < A, 


t-i 

J^(l + Oi) < ^ ( Si{ai,..., Oyj) + (1 + A)™ • 5^(01,..., ttui). 

i i—1 
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Let Z, = exp(0r,) - 1. Let p{Z) = 5,(Zi,..., Z^). Applying the above inequality to 

Z = {Zi ,..., Zy,) we get 


E [exp(0(yi + • • • + i;,))] = E 


11(1 + Z,) 


< E[p{Z)] + exp(6»w) • E[Si{Z)] < 


E[p{Z)] + exp{0w) ■ 




where the last inequality follows because Z’s are ^-wise independent so that by Fact 3.14 


E[5,(^)]= ^ Y[^[Zr]< 

iciw],\i\=ei&i 




w 


) ^ 


Now, for any i G [w], 


E[Zi 


= E 

i=i 


em[Yi] 


j! 


i=i 


0^ E[F,] 


j! 


= E[y,](e® 


I). 


Therefore, Y^iE[Zi] < e®(^-E[li]) = e® • /r. Finally, note that as {Zi,... ,Zyj} are £-wise 
independent, the expectation of p{Z) would be the same as when the Z's were independent. 
However, in this case. 


E[p{Z)] < E 


]^(1 + Zi ) 


nE[(i+^.)]- 


Combining the above equations, we get 

E [exp(6»(Yi H-h T^))] < ]^E[exp(6»y,)] + exp(6»w) • ■ {e^p/wY 

/TT« 7 r , exp(26»u;)(e^)^ 

< J_ J_E[exp(6»rO] +- ji -. 

i 

This finishes the claim. 


□ 
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